(N 



Lower limits for distributions of randomly stopped sums Q 
D. Denisovjls. FossJland D. Korshuno\0 
Eurandom, Heriot-Watt University, and Sobolev Institute of Mathematics 

Abstract 

" We study lower limits for the ratio of tail distributions where F*^ is a distribution 

1^^* ' F[x) 

' of a sum of a random size r of i.i.d. random variables having a common distribution F, and a 

, random variable r does not depend on summands. 
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OO . 

psj , 1. Introduction. Let q, ii, ^2, ■ ■ ■ be independent identically distributed random variables. We 

assume that their common distribution F is unbounded from the right, that is, F{x) = F{x, oo) > 
'■ for all X. Put = and £•„ = ^1 + . . . + n = 1, 2, . . . . 

P_l . Let T be a counting random variable which does not depend on {^n}n>i- Denote by F*'^ the 

I distribution of a random sum S'r = + ... + ^t- In this paper we study lower limits (as x — > oo) 

for the ratio . 

F(x) 

We distinguish two types of distributions, heavy- and light-tailed. A random variable r] has a 
heavy-tailed distribution if Ee^'' = oo for all e > 0, and light-tailed otherwise. 

We consider only non-negative random variables and, in the case of heavy-tailed F, study 
conditions for 

lim inf _ ^ ' = Er (1) 

'sj- ■ F{x) 

to hold. This problem has been given a complete solution in IH for r = 2, and then in |[3l 
i for T with a light-tailed distribution and for heavy-tailed summands. In the present work, we 

generalise results of |[3l onto classes of distributions of r which include all light-tailed distributions 
and also some heavy-tailed distributions. With each heavy-tailed distribution F, we associate a 
^ , corresponding class of distributions of r. For earlier studies on lower limits and on a related 

^ I problem of justifying a constant K in the equivalence ~ KF{x), see e.g. d El HI 111 HI 

and further references therein. 

Since the inequality ">" in ([T|l is valid for non-negative without any further assumptions 
(see, e.g., ||9l or |[3l), we immediately get the equality if Er = oo. Therefore, in the rest of the 
paper, we consider the case Er < oo only. Our first result is 



O 



'The research of Denisov and Foss was partially supported by the EPSRC Grant EP/E033717/1. The research of 
Foss and Korshunov was partially supported by the Royal Society International Joint Project Grant 2005/R2-JP. The 
research of Korshunov was partially supported by Russian Science Support Foundation. 

^Address: School of MACS, Heriot-Watt University, Edinburgh EH14 4AS, UK. E-mail address: 
Denisov@ma.hw.ac.uk 

^ Addi-ess: School of MACS, Heriot-Watt University, Edinburgh EH14 4AS, UK; and Sobolev Institute of Mathe- 
matics, 4 Koptyuga Pr., Novosibirsk 630090, Russia. E-mail address: S.Foss@ma.hw.ac.uk 

''Address: Sobolev Institute of Mathematics, 4 Koptyuga pr., Novosibirsk 630090, Russia. E-mail address: Kor- 
shunov @math.nsc.ru 



1 



Theorem 1. Assume that ^ > is heavy-tailed and < oo. Let, for some c > E^, 

P{cr > x} = o{F{x)) as X ^ oo. (2) 

Then ([T]) holds. 

The proof of Theorem 1 is based on a study of moments Ee-^^^^ for appropriately chosen 
concave function /. More precisely, we deduce Theorem [T] from the following general result 
which explores some ideas from 



Theorem 2. Assume that ^ > « heavy-tailed and E^ < oo. Let there exists a function f : 
— ^ R such that 

Ee/(0 = oo, (3) 

and, for some c > E,^, 

Ee^(^^) < oo. (4) 

If f{x) > In xfor all sufficiently large x and if the difference f{x) — In x is an eventually concave 
function, then ([T]) holds. 

In particular, the equality (O is valid provided E^*^ = oo and Er'^ < oo for some k > 1; it is 
sufficient to consider the function f{x) = klnx. Earlier this was proved in |[3l Theorem 1] by a 
more simple method. 

If we consider instead the function f{x) = ^x, 7 > 0, then we obtain the equality ([T]) provided 
^ is heavy-tailed but r is light-tailed. This is Theorem 2 from |[3l. 

Finally, the equality ([T]) is valid if F is a Weibull distribution with parameter f3 € (0, 1), 

F{x) = e~^' and f{x) = x^ or, more generally, f{x) = x^ — clnx for x > 1 where c < /3 is 
any fixed constant. 

The counterpart of Theorem [T] in the light-tailed case is stated next. But first we need some 
notations. By the Laplace transform of F at the point 7 G R we mean 



/•oo 

^(j) = / e^^F(dx) e (0, 00] 
Jo 



Put 

7 = sup{7 : (^(7) < 00} € [0, 00]. 

Note that the function (p{'y) is monotone continuous in the interval (—00, 7), and 99(7) = liin 93(7) G 

7T7 

[1,00]. 

Theorem 3. Let 7 G (0, 00], so that 93(7) G (1, 00]. /f© holds and, for any fixed y > 0, 

liminf ^^"^^ > e'^y, (5) 

then 



lim inf _ ^ ' = Er(^^-i(7). 

X^QO F(x) 
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The paper is organised as follows. In Section 2, we formulate and prove a general result on 
characterisation of heavy-tailed distributions on the positive half-line. Section 3 is devoted to the 
estimation of the functional Ee'^*^'^"^ for a concave function h. Sections 4 and 5 contain proofs of 
Theorems |2] and [T] respectively. Section 6 is devoted to the proof in light-tailed case. 

2. Characterisation of lieavy-tailed distributions. It was proved in ||3l Lemma 2] that, for 
any heavy-tailed random variable ^ > and for any real 6 > 0, there exists an increasing concave 
function h : R+ R+ such that Ee'^'^^^ < 1 + 5 and E^e'^*^^) = oo. In the present section, we 
obtain some generalisation of it. 

Lemma 1. Let > be a random variable with a heavy-tailed distribution. Let f : TUbe 
a concave function such that 

Ee^(^) = oo. (6) 

Let a function g : R+ ^ Tl be such that g{x) ^ oo as x ^ oo. Then there exists a concave 
function h : R+ R such that h < f and 

Ee'^(«) < oo, Ee'^(«)+5«) = oo. 

Proof. Without loss of generality assume /(O) = 0. We will construct a function h{x) on the 
successive intervals. For that we introduce two positive sequences, T oo as n — > oo and 

e„ G (0, 1]. We put xq = 0, h{0) = /(O) = 0, h'{0) = /'(O), and 

h{x) = h{xn-i) + En min(/i'(x„_i ) (x - x^-i), /(x) - /(x„_i)) for x € (x^-i, x„]; 

here h' is the left derivative of the function h. The function h is increasing, since e„ > and 
/ is increasing. Moreover, this function is concave, due to e„ < 1 and concavity of /. Since 
h{x) - h{xn-i) < /(x) - /(x„_i) for x e (x„_i, x^], we have h< f. 

Now proceed with the very construction of Xn and e„. By conditions g{x) oo and we 
can choose xi so large that e^^^-* > 2^ for all x > xi and 

E{emin{h'(o)5,/(0);^ g (xo,xi]} + e'"'^('^'(°)^i'^(^i))F(xi) > F(xo) + L 

Choose ffi € (0, 1] so that 

E{e^imm{h'(o)C,/(€)).^ g (xo,xi]} + e^i'^'°('^'(°)^i'-^(^i))F(xi) = F(xo) + I. 

Put h{x) = ei min(x, /(x)) for x G (0, xi]. Then the latter equality is equivalent to 

E{e^(«); e E (xq, xi]} + e'^("i)F(xi) = e''("o)F(xo) + 1/2, 

By induction we construct an increasing sequence x„ and a sequence e„ G (0, 1] such that 

efi'(^) > 2" for all x > x„, and 

Eje'^^); C G x„]} + e'^(^")F(x„) = e'^(^"-i)F(x„_i) + 1/2" 

for any n > 1. For n = 1 this is already done. Make the induction hypothesis for some n > 2. 
For any x > x„, denote 

5{x,e) = e''(^")(E{e"°^''^('^'(^")(«-^")'^(«)-^(^"»;e G (x„,x]} 




3 



By the convergence g{x) — > oo, by heavy-tailedness of ^, and by the condition there exists 
Xn+i SO large that e^^^^ > 2"+^ for all x > Xn+i and 

6ixn+i,l) > e'^("")F(x„) + 1. 

Note that the function S{xn+i,e) is continuously decreasing to e'^^^"^F{xn) as e J. 0. Therefore, 
we can choose €„,+! G (0, 1] so that 

6ixn+i,en+i) = e'^(^")F(x„) + l/2"+i. 

Then 

Our induction hypothesis now holds with n + 1 in place of n as required. 
Next, for any N, 

N 



n=0 

N 

^(e^(^")F(x„) - e^(^"+i)F(x„+i) + l/2"+i 

n=0 

< e'^("o)F(xo) + 1, 
so that Ee^*^^) is finite. On the other hand, since e^^^^ > 2^ for all x > x^, 

E{eM5)+9«).^>^4 > 2"(E{e'^(«);ee(x„,x„+i]} + e'^(^"+^)F(x„+i)) 

= 2"(e''(^")F(x„) + 1/2"+^). 

Then, for any n, E{e''(^)+f«); ^ > a;^} > 1/2, which implies Ee''(^)+s(^) = 00. The proof is 
complete. 

Lemma 2. Let > be a random variable with a heavy-tailed distribution. Let fi : R 
be any measurable function and /2 : R^ — > R a concave function such that 



Ee-^i(^) < CX3 and Ee^^^^^^^^^^^ 



00. 



Let a function g : R^ ^ H be such that g{x) ^ 00 as x ^ 00. Then there exists a concave 
function h : R+ R such that h < f2 and 

Ee/i«)+MO<oo and Ee^i«)+'^«)+^(«) = 00. 

Proof Consider a new governing probability measure P* defined in the following way: 

^ ^"^^ ~ ■ 

Then 

E*e^2«) = \^ , = 00. 

Ee/i(5) 
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In particular, ^ is heavy-tailed against the measure P*. Now it follows from Lemma [T] that there 
exists a concave function h : R+ R such that h < f2, h{x) = o{x), E*e'^(^) < oo, and 
^*eHO+9iO = oo. Equivalently, 

Ee/i(0+MO = Ee^i«)E*e'^«) < oo 

and 

^ghiO+hiO+giO ^ Ee^i(0E*e''(^)+5(^) = oo. 

The proof is complete. 

3. Growth rate of sums in terms of generalised moments. According to the Law of Large 
Numbers, the sum Sn growths like nE^. In the following lemma we provide conditions on a 
function h{x), guaranteeing an appropriate rate of growth for the functional Ee'^*^'^"). 

Lemma 3. Let be a non-negative random variable. Let h : Y{,be a non-decreasing 

eventually concave function such that h{x) = o{x) as x ^ oo and h{x) > Inx for all sufficiently 
large x. If'Ee'^^^^ < oo, then, for any c > E^, there exists a constant K{c) such that Ee'^*^'^") < 
K{c)e^^"^''\forall n. 

To prove this lemma, we need the following assertion, which generalises the corresponding 
estimate from |[6l : 

Lemma 4. Let t] be a random variable with Er/ < 0. Let h : It ^ It be a non-decreasing and 
eventually concave function such that h{x) = o{x) as x ^ oo and h{x) > Inx for all sufficiently 
large x. If'Ee^^'^^ < oo, then there exists xq such that the inequality 'Ee^^^^^^ < e^^^^ holds for 
all X > xq. 

Proof. Since h is increasing, without loss of generality we may assume that t] is bounded from 
below, that is, rj > M for some M. Also, we may assume that h is non-negative and concave on 
the whole half-line [0, oo). 

Since h is concave, h'{x) is non-increasing function. With necessity h'{x) — > as x — > oo, 
otherwise the condition h{x) = o{x) is violated. If ultimately h'{x) = 0, then h is ultimately a 
constant function and the proof of the theorem is obvious. 

Consider now the case h'{x) — > as x — > oo but h'{x) > for all x. Put g{x) = l/h'{x), 
then g{x) | oo as x ^ oo. Since Er^ < 0, we can choose sufficiently large A such that 

e = E{r/;r/ G [M,^]} + eE{7/;7/ > A} < 0. (7) 

By concavity of h, for any x and y G R we have the inequality h{x + y) — h{x) < h'{x)y. Hence, 

^^h{x+r^)-h{x) < E{e'^'(^)^; r/ € [M, A]} + E{e'''(^)''; r] € (.4, ^(x)]} 
^E{e'*(^+^)-^W;ry > g{x)} 
= El + E2 + E^. (8) 

Since h'{x) — > 0, the Taylor's expansion for the exponent up to the linear term implies, as x — > 00, 

El = P{??e [M,A]} + /i'(x)E{r/;r/G [A/,A]}+o(/i'(x)). (9) 

On the event G {A, g{x)] we have h'{x)rj < 1 and, thus, e^'^^^^ < 1 + eh'{x)r]. Then 

E2 < P{ve{A,g{x)]} + eh'{x)B{ri;rie{A,g{x)]}. (10) 
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We have 

^3 = E{e^('')e^(^+^)-'*(^)-''('');r/ > (11) 

By concavity of h, for x > 0, the difference h{x + y) — h{y) is non-increasing in y. Therefore, 
for any y > g{x), 

h{x + y) — h{x) — h{y) < h{x + g{x)) — h{x) — h{g{x)) 

< h'{x)g{x) - h{g{x)) 
= ^-h{g{x)) 

< l-\ng{x), 

due to the condition h{x) > Inx for all sufficiently large x. This estimate and (fTTI) imply 

^3 < E{e'^('');r/ > g(x)}ei~''^3W 

= o{l) / g{x) = o{h' {x)) asx^oo, (12) 

by the condition Ee'^^^^ < oo. Substituting (flOl ) and (fT2]) into ^ and taking into account the 
choice ^ of A, we get 

■g,gh{x+r;) _ ^h{x)^^h(x+r))-h(x) 

as X — > oo. 

Since e < 0, the latter estimate implies 'Ee^^^'^'^^ < e^^^'^ for all sufficiently large x. The proof is 
complete. 

Proof of Lemma |3] Put rjn = in — c. We have Et/„ < and Ee'^^''") < oo. By Lemma |4l 
there exists xq > such that Ee'^'^^^''"^ < 'Ee^^^^ for x > xq- Then, by monotonicity of h{x) and 
by non-negativity of S^.i, 

Now, by the induction arguments, Ee'*^'^") < e'^('^"+^o) < ^Hcn) ^h{xo) _ jj^g pj-pof is complete. 

4. Proof of Theorem 121 Before starting the proof of Theorem |2l we formulate the following 
proposition from ||3l Corollary 1]: 

Proposition 1. Let there exist a concave function r : R such that Ee^^^^ < oo and 

= oo. If F is heavy-tailed and Ere^'^'^^^^^ < oo, then ([T]) holds. 

We also need two auxiliary technical results. 

Lemma 5. Let x ^ be any random variable. Then there exists a differentiable concave function 
g : R+ R+, g{Q) = 0, such that g'{x) < I for all x, g{x) ^ oo as x ^ oo, and Ee^^-^^ < oo. 

Proof. Consider an increasing sequence {x„} such that xq = 0, xi = 1, x„+i — Xn > Xn — Xn-i, 
and P{x > Xn} < e^". Put 51 (x„) = n/2 and continiously linear between these points. Then, 
for any x G (xn, Xn+i) and y G (x^+i, Xn+2) we have 

9iix) = TTT — V > ~ V = s'liy), 

^{Xn+l - Xn) 2[Xn+2 - Xn+l) 
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so that gi is concave. By the construction, j oo as x — > oo and g'i{x) < 1 where the 
derivative exists. Finally, 

oo oo 
n=0 n=0 

A procedure of smoothing, say g{x) = /^^^ gi{y)dy — gi{y)dy, completes the proof. 

Lemma 6. Let be a random variable such that, for some concave function f : — > R+, 

Eg/{x) = oo. Then there exists a concave function fi : — > R^ such that fi < f, fi{x) = 
o(x) as X ^ oo, and Ee-^^^*^-^^ = oo. 

Proof. Take xi so large that Eje™™*^-^'-^'-^^^ ; x < 2:1} > 1 and put /i(x) = min(x,/(x)) for 
X G [0, xi]. Then by induction, for any n, we can choose x^+i such that 

E{QfiM+min{n-^f[ix,,)ix-x„),fixyf{x„)).^^ (Xn,X„+i]} > 1. 

Let /i(x) = fi{xn) + inin{n~^f{{xn){x - Xn),f{x) - /(x„)) for x G (x„,x„+i]. By construc- 
tion, /i is concave, /i < /, and /{(x„+i) < /((x„)/n ^ as n ^ oo. 

Proof of Theorem |2] Without loss of generality, assume that /(x) > Inx for all x and that 
/2(x) = /(x) — Inx is concave on the whole posititive half-line. By Lemma |6] and by measure 
change arguments like in the proof of Lemma |2] we may assume from the very beginning that 

/(x) = o(x) as X — > oo. 

Next we state the existence of a concave function g : R+ R such that g{x) — > oo as x ^ oo, 
g{x) < Inx for all sufficiently large x, the difference Inx — g{x) is a non-decreasing function, 
and 

Indeed, by Lemma |5] and again measure change technique, there exists a differentiable concave 
function 51 : R+ ^ R+ such that 51 (0) = 0, 51 (x) j 00, g[{x) < 1, and Ee-^^'^^^+^i^^^) < 00. 
Put ^(x) = gi (ln(x+ 1)) — 1. Then 5 is a monotone function increasing to infinity and g{x) < In x 
for all sufficiently large x. In addition, 

(Inx - g{x)y = 1/x - 5'i(ln(x + l))/(x + 1) > 0, 

so that the difference Inx — g{x) is a non-decreasing function as needed. 

Since the function f2{x) is concave, by Lemma |2] with /i(x) = Inx, there exists a concave 
function h such that h < /2, h{x) = o(x), E^e''^^) < 00 and E^e'^^^^+S'^^^ = 00. Since Inx + 
/i(x) + g{x) < /(x) + ^(x), by (HJl and by the choice of g, 

The concave function r(x) = h{x) + g{x) satisfies all conditions of Proposition [T] Indeed, due to 
the inequality g{x) < Inx for all sufficiently large x, we have Ee''^^-* < oo because E^e''^^-* < oo. 
It remains to check that 'Ere'^^^^-'^'^ < oo. Since, by ([T3] ). 

E{re^(^-);5^ < cr} < Ere'^^^^) < oo, 
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it suffices to prove that 

oo. 

We proceed in the following way: 

oo 

E{cre^("^-) ; Sr > ct} = ^ P{t = n}cnE{e^(^") ; 5„ > cn} 

n=l 
oo 

= ^ P{t = nje^^^^^+^'^^'^^-f (^")E{e''(^")+f ; 5„ > cn}. 

n=l 

By the monotonicity of the difference Inx — g{x), we obtain the following estimate 

oo 

E{cre"(^-);5, > cr} < ^P{r = n}e^('=")E{e''^^"+'^(^"); S„ > cn}, 



n=l 



Since the function Inx + h{x) is concave and Inx + h{x) > Inx, by Lemma[3l 
for some K(c) < oo. Therefore, 



E{cTe"(^-); Sr > ct} < K{c) ^ P{r = n}e5('=")e 



\n(cn)+h(nc) 



n=l 



= E:(c)cEre'^(^^)+^^("^) < oo, 

from ([T3] ). The proof of Theorem |2] is complete. 

5. Proof of Theorem [H Denote by G the distribution function of cr. 
We will construct an increasing concave function / : R+ R such that 

E^e^(^) = oo and Ere-^^'^^) < oo. (14) 

Then the desired relation [Hi will follow by applying Theorem |2l 

If G is light-tailed then one can take f{x) = Xx for a sufficiently small A > 0. ^From now on 
we assume G to be heavy-tailed. 

Consider new random variables and with the following distributions: 

■^r^ ,1 xF(dx) , -^r T nP{T = n} 
P{e* G dx} = and P{n = n} = i- 

Denote by F* and G* the distributions of and cr* respectively. Then both and are 
heavy-tailed and 

G:t{x) = o{F^,{x)) as X ^ oo. (15) 
The heavy-tailedness of is equivalent to the following condition: for any e > 0, 

/oo roo 
G^{e'^^lnx)dx = J e^G^,{x/e)dx = oo. (16) 
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In terms of new distributions and G^, conditions (fT4l) nay be reformulated as follows: we need 
to construct an increasing concave function / such that Ee-^*^^*) = oo and Ee-^^"^^*) < oo, or, 
equivalendy, 



/oo /'OO 
F^{f-^{\nx))dx = oo and j G*(/"^(ln 



x))dx < oo. (17) 



The concavity of / is equivalent to the convexity of its inverse, h = f ^. So, conditions ([TT] ) may 
be rewritten as: we have to present an increasing convex function h such that 

f'OQ poo 

I e^'F^{h{x))dx = OO and / e^G ^{h{x))dx < oo . (18) 
Jo Jo 

We will construct h{x) as a piece-wise linear function. For this, we will introduce two increas- 
ing sequences, say Xn^ oo and a„ j oo, and let 

h{x) = h{xn) + an{x - Xn) for X £ (x„ , X^+i] . 

Then the convexity of / will follow from the increase of {a„}. 

Put xq = and /(xq) = 0. Due to ([T5] ) and ([T6l ). we can choose xi so large that 

IM > 2' 
GM ~ 

for all y > xi and 

rxi 

/ e^G*(/i(xo) + 1 • (x - xo))c?x > 1. 
Jo 

Then there exists a sufficiently large ao > 1 such that 

rxi 

e^G^:{h{xQ) + ao{x — xo))dx = 1. 

'0 

Now we use the induction argument to construct increasing sequences {x„} and {a„} such 



Jo 



that 



for all y > Xn+i and 

/ e^G,(/i(x))dx = 2-". 

Jxn 

For n = this is already done. Make the induction hypothesis for some n > 1. For any x > x„+i, 
denote 

j-X 

6{x,a) = / e^G*(/i(xn+i + a(2/ - Xn+i)))d2/. 

J x„+i 
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Due to (fTSl ) and (fT6l ). we can choose x„+2 so large that 
for all y > x„+2 and 

(5(a;„+2,«n) > 1- 

Since the function d{xn+2,CL) continuously decreases to as a | oo, we can choose Un+i > cin 
such that 

Then 

Xn + 2 

e''G4h{x))dx = 2-("+i). 

Xn + l 

Our induction hypothesis now holds with n + 1 in place of n as required. 

Now the inequalities ([TSl l follow since, from the construction of function h, 

/ e^G^{h{x))dx = ^ e'G^{h{x))dx 

oo 

= 



< oo. 

n=0 



and, by 



/ e'F^{h{x))dx = ^ j e'F^{h{x))dx 
Jo Jx„ 

n=0 

oo 



CX3. 

n=0 



The proof of Theorem [I]is complete. 

6. Proof of Theorem |3l We apply the exponential change of measure with parameter 7 and 
consider the distribution G{du) = e^^ F {du) / ip{^) and the stopping time v with the distribution 
P{z^ = k} = ip^(^)'P{T = /c}/E(^'^(7). Then it was proved in |[3l Lemma 3] that 



liniinfS^ > L^liminfS^. (20) 

^^00 G{x) ~ E(^^-i(7) x^oo F{x) 

^From the definition of 7, the distribution G is heavy-tailed. Let us prove that 

P{ci/ > x} = o{G{x)) as x ^ 00. (21) 
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Indeed, put A = In 92(7) > 0; then 

^ ^ k>x/c 

1 f'°° 

Ey'^iT) Jx/c 

Integration by parts implies 

/>00 /-OO 

/ e^^P{r G dy} = -e^^P{T > y} + A / e^^P{T > yjdy 

Jx/c ^l'^ Jx/c 

= e^'^/'^PicT >x} + - / e^yl^V{cT > y}dy, 

because E(/7^(7) < 00 and, thus, e^^P{r > y} ^ as y — cxo. Now applying the condition Q 
we obtain that the latter sum is of order 

o(^e^'^I^F{x) + - j e^y/''F{y)dy^ ^ "ij ^^^^^^(^2/)) as x ^ 00. 
Together with (l22l ) it implies (|2TI ). Therefore, by Theorem[T]we have the equality 

liminf _ ^ ^ = Ei/ = — ^^-7^^, 

and, due to (l20l ). 



liminf ^-Y < Et(^--1(7). (23) 



The result now follows from Lemma . 
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